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THE MATHEMATICAL BIOPHYSICS OF SOME MENTAL 
PHENOMENA: II. ANXIETIES AND ELATIONS 


N. RASHEVSKY 
THE UNIVERSITY OF CHICAGO 


A neural mechanism is discussed which explains certain states of 
anxieties, in which an individual is worried about things which may be 
possible, but are exceedingly improbable. Certain quantitative relations 
are derived. _Mutatis mutandis similar considerations apply to some 
eee of elations. An application to certain types of paranoia is dis- 

ed. 


Any given situation which confronts an individual has, as a rule, 
a large number of possible consequences, of different degrees of prob- 
ability, as well as different degrees of pleasantness. Thus, taking a 
walk may result in the mere sensation of walking, usually pleasant, 
and very probable. Or it may result in getting wet in a rain, which 
may be less probable and more unpleasant; or it may result in being 
injured by an automobile, which is rather improbable, but highly un- 
pleasant; or it may result in finding a thousand-dollar bill, which is 
is also highly improbable, but exceedingly pleasant. Any given situa- 
tion may be viewed as a complex stimulus pattern. Let us denote it 
by S. 

If the same situation, or a set of similar situations, recurs fre- 
quently during the life time of an individual, then, since every time 
when it occurs, it is followed by one of the possible consequences, it 
becomes eventually associated through conditioning with all of those 
consequences. The strength of the association to a given consequence 
x; will be the greater, the more frequently the sequence S,x; has oc- 
curred in the past (Rashevsky, 1938a, chap. xxvi). But that frequency 
is proportional to the probability P(x;) of 2; occurring when S is 
present. 

Through a mechanism discussed in a previous paper (Rashevsky, 
1945a), when x; becomes conditioned to or associated with S, then 
the experiencing of S makes us anticipate x; in the future. The in- 
tensity of anticipation will be proportional to the strength of asso- 
ciation. Thus any situation S would make us anticipate all, or almost 
all, possible consequences, if our experience with S has been long 


enough. 
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Let, however, all the centers for anticipation of different 2;’s 
(Rashevsky, 1945a) be cross-inhibiting each other. Then only those 
that are most strongly excited, that is, the most probable ones, will 
remain excited, the remaining ones being inhibited. The intensity of 
excitation e; of any x; is given by 

6; = Co — DD Cox, (1) 


k#i 


where €,; is the intensity as determined by the strength of association. 
For very large numbers of x; , we may substitute an integral for the 
sum, considering x as a continuous variable: 


eee Gan [veo(a)ae. (2) 


But, with a as a coefficient, 
€é)(x1) =a P(x), (3) 
where P(a) is the probability of x. Therefore 


e(a) =aP(x) —ab [ P@ae, (4) 

or, ‘since 
[ P@ac=1, (5) 
e(x) =a [P(x) — bd]. (6) 


If the inhibitory constant b is larger than the probability P,, of 
the most probable consequence x of S, then no consequences will be 
anticipated at all. This is a particular case of the general phenome- 
non of mutual inhibition of too many centers (Rashevsky, 1938, chap. 
Xxii). 

According to the theory of pleasantness and unpleasantness, de- 
veloped before (Rashevsky, 1938a, 1940), the pleasantness of an ex- 
perience is measured essentially by the intensity of excitation E of 
certain cortical regions, or perhaps even of the cortex as a whole. 
Since each x, or the anticipation of it, acts itself as a stimulus, there- 
fore the experiencing of a given x or the anticipation of it, will re- 
sult in a definite intensity of excitation E (x) in the cortex. 

In discussing problems of discrimination of intensities of peri- 
pheral stimuli, we pointed out (Rashevsky, 1938a, 1940) that since 
different reactions may be produced by different intensities of the 
same stimulus, those different intensities must involve different neu- 
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rons, or groups of neurons, even though the peripheral stimulus is 
applied always to the same afferent fibers or pathways (Rashevsky, 
1945b). A mechanism was suggested which gives such an effect (Ra- 
shevsky, 1938b). It was further developed by A. S. Householder 
(1939, also Householder and Landahl, 1945) and successfully applied 
to a number of experimental data. 

There is no sufficient reason to limit such considerations to in- 
tensities of peripheral excitation only. In fact, the generalization to 
central excitation is almost mandatory. We react quite differently 
to exhibit different degrees of pleasure or displeasure. Hence we must 
postulate a similar mechanism, which results in the excitation of dif- 
ferent groups of neurons Nz.) for different values E(x) of the cen- 
tral excitation. 

If we now make the rather plausible assumption that all condi- 
tioned and associative connections are two-way connections so that 
if a stimulus s, is conditioned to a stimulus s., then s, is also condi- 
tioned to s,, then we come to the conclusion that not only does the 
experiencing of « produce a central excitation H(x) but, vice versa, 
if the central excitation has a given value # (x) then, through the 
group of neurons N,,-) it will excite the center, whose functioning 
corresponds to the anticipation of x. 

Let now the individual be confronted with the situation S and 
let at the same time the level of the central excitation be maintained 
at a given level E(x’) through some endogenous or exogenous influ- 
ences. Then equation (3) will hold only for such values of x which 
are different from x’. For the latter we shall have 


eo(a4’) =a P(x’) +T, (7) 


where I denotes the additional excitation received by x’ from the group 
of neurons Nz,z). Instead of equation (2) we now have for x # 2’ 


e(2) =e(z) —b| ie Jveotayar | (8) 


or instead of equation (6) 
e(x) =a [P(x) —b] —Dl. (9) 
For « = x’ we have 
ele) —a(P Ge) —o] 47. (10) 
Whereas in the absence of the additional excitation IJ only the 
most: probable x’s are excited, now, even if b < P,,, the most prob- 


able x = x, may remain unexcited, while the one which is additional- 
ly excited by Nz, will be excited. Or it may happen that while in 
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the neighborhood of « = #, the «’s still remain excited, an x = 2’, 
having the additional excitation I, will also be excited, even more 
strongly than 7%, . 

Let us arrange all x’s in decreasing order of their pleasantness, 
so that « = 0 is the most pleasant. In the average life of an average 
individual most situations are of such a nature that their most prob- 
able consequences are neither too pleasant, nor too unpleasant. The 
extremely pleasant or extremely unpleasant consequences of S are as 
a rule improbable, as in the example given at the beginning of this 
paper. Hence P(x) will have its maximum value P,, for some value of 
X = %m, Which is of average pleasantness. Let, for instance, P(2%) — 
be a normal] distribution 


ah 
Ey = 
V2a10e 


@- (Fm-2)?/20? | (11) 


If the individual is confronted with S at a time when his central 
excitation level is in the neighborhood of E(x»), then all highly pleas- 
ant and highly unpleasant x’s will be inhibited, and only the 2’s in 
the range between the two roots of the equation 


a [P(x) —b] —bI=0 (12) 


will be excited. The individual anticipates average, most probable 
events of average pleasantness. But if the situation S is confronted 
when the value E(x) corresponds to x’ >> x, , then in the neighbor- 
hood of « = 4m we shall have equation (9), but for 2’ we shall have 
expression (10). If P(x) is given by equation (11), then 


. 4 
(x) =a zEy pl ade I, (13) . 
V2an0e0 
€ (atm) : b 
m) = =a ae =~ Of¢ 
V2a0 | us ; 
If ; 
1 i+a 
b <<———-<b ; se (18) F 
V2a0 a 
aCe) = Oo. eee mre) 


then’ only «’ will be excited. The individual anticipates such ¢onse-' 
quences of 'S which are unpleasant and unlikely. Because of equation’ 
(13), inequality (16) imposes a condition upon’. Thus for given *- 
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a, Oa fre » and %m, the probability of x may have to be above a cer- 
tain value, in order that x’ would be anticipated. If, however, 


Dow a0. (17) 


then inequality (16) is always satisfied, but inequalities (15) may or 
may not be satisfied. If they are not, then besides x’, x’s in the neigh- 
borhood of x,, will also be anticipated. 

Thus the lowering of the excitatory level E(x) results in a shift 
of associations and anticipations of the consequences of a given situa- 
tion towards such, which are unpleasant, and as a rule, highly im- 
probable. We have an elementary mechanism of some anxiety neu- 
roses when everything appears gloomy in the future and when an 
individual may worry over utterly unlikely possibilities. If at that 
moment a highly pleasant experience increases F(a), and if this in- 
crease is not upset by some other influences (pathological condi- 
tions), the whole mood of the individual will change, and the future 
will appear “rosy”. 

Conversely, if an individual has an abnormally high level of 
E(x), then, even in average circumstances, he will anticipate most 
pleasant, but unlikely events (x << 2,,). The choice of the constants 
a,b, and/, together with the individuals normal level E(x) deter- 
mine for a given situation whether the individual is an optimist or a 
pessimist. 

There may be a very great number of factors which can deter- 
mine the average level of E(x). In an individual who reacts rather 
emotionally to eating and likes very much good food, mere hunger or 
an upset stomach may lower E(x) and produce temporarily a pessi- 
mistic attitude. On the other hand, a number of yet unknown or un- 
controlled factors, like metabolism, endocrine activities, etc., may play 
an important role. 

In a previous paper (Rashevsky, 1945a) we discussed possible 
mechanisms of some forms of paranoia. It may be pointed out that 
the mechanism discussed here can very well also give rise to paranoid 
conditions. In the present instance the paranoia may be due not to 
any defect of the mechanism of logical thinking, but to the faulty 
choice of the premises. A very large number of consequences may 
follow from a situation S. If, due to the above discussed mechanism, 
the individual chooses a very unlikely one, then with impeccable logic, 
he will arrive at deductions which will be in conflict with reality, and 
may lead the individual to social conflict. Thus, purely logically, there 
is the possibility that every other individual, with whom an individ- 
ual A comes in contact, hates A and conspires against him. If A ac- 
cepts this as the major premise, then if he sees that B is actually very 
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kind to him, the very impeccability of A’s logic will force him to argue 
that B is kind to him in order to deceive him by his kindness. The 
roots of some paranoias may be not in the defect of logic, but in the 
defect of choosing the major premises. In real life this choice has in 
most cases to be made on probability bases. The mechanism discussed 
in this paper provides for the possibility of a forced choice of very 
improbable things. 

Another interesting consequence of this theory is that an in- 
dividual with low E(x) will anticipate as a rule most unlikely things, 
and is apt to overlook the more likely ones. This may result in a 
number of unpleasant situations which might have been avoided, had 
the individual thought of more likely things. The unpleasant situa- 
tion will lower E(x) further, and thus the situation gets worse, until 
it may end in a psychosis. 

In general, P(x) is a function of time, P(xz,t). Instead of equa- 
tion (3) we have 


€,(2,t) =a [ Pa@nadt=arwen, (14) 


The effect of the past experience of the individual is thus made ex- 
plicit. 

This work was aided in part by a grant from the Dr. Wallace C. 
and Clara A. Abbott Memorial Fund of the University of Chicago. 
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CHAIN PROCESSES AND THEIR BIOPHYSICAL 
APPLICATIONS: PART II. 
THE EFFECT OF RECOVERY 


I. OPATOWSKI 
THE UNIVERSITY OF CHICAGO 


The biological effects of radiations are studied on the basis of a gen- 
eral probabilistic model of successive transformations (Markoff chains). 
The process of recovery is taken into account as a series of reverse 
transitions. The theory gives methods for calculating the probability 
of subjecting a microorganism to an observable change within an as- 
signed time during a process of irradiation of a homogeneous aggre- 
gate of microorganisms. Two methods of calculation are given: one re- 
quires the solution of a secular equation, the other one consists of ex- 
pansions in power series of the intensities of recovery. 


1. The object of the paper. In Part I of this paper equations of 
some types of chain processes as they occur in biophysical applica- 
tions, particularly in the study of biological effects of radiations, were 
given, and a general method of their solution was derived (Opatow- 
ski, 1945; this reference will be indicated as “Part I’’). The purpose 
of the present Part II is to study these processes from a computa- 
tional viewpoint, so that an evaluation of the theory on the basis of 
experimental material may be possible. 

Because of the corpuscular character of radiations as well as of 
the biologic aggregates subject to experimentation, the phenomena 
in this field are of a probabilistic nature. Nevertheless, they have 
been presented in Part I in a deterministic manner as an approxima- 
tion of the actual process. In the field with which we are mainly 
concerned the primary events consist of collisions of radiation quanta 
with single biological entities. Quite often we must bind our investi- 
gations to a certain cumulative effect of several such events. The 
probability of occurrence of an effective event in the sensitive volume 
is in general dependent on the events which already took place in the 
same volume, because in general each event produces some change 
of that volume. Processes of this type belong to the category known 
as Markoff chains. In our field the succession of single events is in 
general sufficiently rapid to enable us to apply the asymptotic theory 
of these processes and consequently to treat them formally in a de- 
terministic manner, as has been done in Part I. 

We assume that at least some of the events occurring in the sen- 
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sitive volume change the microorganism. These changes are inter- 
preted as transitions of the organism to certain new states which are 
numbered (0,1,-::,7,-°:: ”), 0 being the initial state and n a state 
under observation. Consider any two transitions of the type (i — 1 
— i) and (¢ + 1— 7), where 7 has an assigned value. It is assumed 
that the probabilities for the occurrence of these transitions in any 
interval of time At are respectively k; At + o(At) and g; At + o(At), 
where k; and g; are independent of t and o(At) are infinitesimals of 
higher order with respect to At. The probability of a transition with- 
in any interval of time At between two states which are not contigu- 
ous in the array (0,1,---, 7), is assumed to be also infinitesimal of 
higher order with respect to At. The transition (2 + 1 — 7) is inter- 
preted as an effect of recovery, the transition (t — 1 — 7) being in 
a more direct relation to the action of radiation. The function which 
is of interest in applying this probabilistic model to experimental re- 
sults is the probability that the organism be at a time t in the state 
n if it was at the time t = 0 in the state 0. This probability function 
is the same Y,(t) to which a deterministic interpretation has been 
given in Part IJ. 

The concept of chain processes for the study of biological effects 
of radiations has been suggested by F. Dessauer (1923) and devel- 
oped by M. Blau and K. Altenburger (1923) in the particular case in 
which g; = 0 and the k;’s are independent of i. The same case has 
been considered by J. A. Crowther (1926) and by many other authors 
(for a review of the subject see Koyenuma, 1943). In the absence of 
recovery, i. e., when g; — 0, a general expression of Y,(t) has been 
known (Bateman, 1910; Opatowski, 1942). The case in which the 
k,’s are independent of 7 and the g;’s are either zero or equal to a con- 
stant g has been also solved recently (Opatowski, 1946). In the pres- 
ent paper methods for the calculation of Y,(t) are given in the gen- 
eral case when the g;’s and the k;’s depend oni. They will be applied 
in the next part of the paper to some more specific processes. 


2. Calculation of Y,(t) by solving a secular equation. In Part I 
it has been found convenient to use besides Y,,(t) also its Laplace 
transform, i.e. 


un(s) = [ee Y, (t)dt=8 (Y(t) 38). (1) 


A general expression of y, is [Part I, equations (11) to (13)]: 
Yn(s) =P,/D(0,n), (2) 
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where P,, = II k, and D(0,”) is a determinant ||q,,.|| of order n + 1 


defined by 


Ayr S05 = Keres a3 Gra ’ Orr = k, ’ Oy ria aa gr ; 
a,¢=O0for|r—el>1; .0Sr,¢5n, as 
all quantities with a negative subscript being equal to zero by defini- 
tion. If s = —k; ((=1,2,---, +1) are the roots of the equation 
D(0,n) = 0 and if they are all different, then (Bateman, 1910) 
i=n+1 j=n+1 = = —1 a 
Lalit Pe), | I (k; — ki) exp (—k;t) . 


#=1 j=1,j#i 


An expression of substantially the same type holds also when some 
of the roots are equal (Opatowski, 1942). However, if g; ~ 0 and 
nm > 3, the only known cases in which the roots of D(0,n) may be cal- 
culated in “finite terms” are two: one solved by T. H. Rawles (1936, 
1937) and M. Fréchet (1938) in which the intensities of transitions 
k; , gi are connected among themselves by a relation of a very special 
character, and the second in which ki = k and gi = g or = 0, k and 
g being two constants (Opatowski, 1946). In other cases the roots 
may be calculated by standard numerical methods. It is known that 
they are all real and negative with a possible exception of one which 
may be zero (Part I, Section 5). The following theorem by A. Stohr 
(1943) gives a general method of locating these roots whatever are 
the values of the constants k; and g;: the interval formed by two con- 
secutive roots of D(0,n—1) = 0 contains always one and only one 
root of D(0,) = 0; if 7, and 7, are the smallest and the largest root 
of D(0,n—1) = 0, each of the intervals (—o, 7,) (T2, + «) con- 
tains also one root of D(0,n) =0. This theorem makes it possible 
to locate all the roots of D(0,”) = 0 starting, for instance, from 
D(0,3) =0, which can be solved algebraically. Another field which 
seems likely to yield a method of calculating the roots of at least some 
types of D(0,7) is that of orthogonal polynomials, since the latter 
may be defined as proportional to the determinants of D(0,) (Szego, 
1939, p. 368). This method, which would involve an application of 
the known results concerning the zeros of orthogonal polynomials has 
not been investigated as yet, except in one case leading to Tchebychev 
polynomials (Opatowski, 1946). 

Experimental results give usually some values of Y, (¢) and no 
direct information as to the elements of the secular equation D(0, 7) 
—(. For this reason, in sections 3 and 4 an approximate expression 
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of Y,(t) will be derived whose use does not require the solution of 
that equation. It consists of expansions in power series of the inten- 
sities of recovery gi . 


3. Some preliminary formulae. We will need in the following 
sections the following formulae for the Laplace transform, for which 
the symbol of equation (1) will be used (see e.g. Doetsch, 1937, pp. 
27, 62, 147-149, 155-164; Widder, 1941; Churchill, 1944, pp. 9-14, 21- 
39, 295): 


fee ee POT ass | 
2{ f b()y(t—z)dr;s £19) p(t) 58 


(4) 

=#16;8| 2 w(t) is}, 
e-0t *F (t) —e-tt f et F(t) dt, (5) 
& {e*; s}=1/(sta), (6) 


Q { (e-4? — e-*t) /(b—a) ; 8S} = & {e* *e*; 8} — 1/[ (sta) (stb) ], (7) 


Q (Fm) (t) - 3} = gmQ {F (t) < et —— ‘ey smi FG) (0) ‘ (8) 


i=0 
where F) (0) = [d‘F'/dt‘];-. fori 2 1 and F® (0) = F (0), 
2 {d(e-% * e%) /dt; s} = 2 { (ae** — be") / (a—b) ¢ 8} 


(9) 
=s/[(st+a) (st+b)]. 


For our purpose it is sufficient to assume here that a and b are positive 
constants and that s is chosen in such a manner as to insure the va- 
lidity of these formulae, which is always possible for the functions 
which we will have to consider. The function F(t) must fulfill certain 
conditions which are, however, satisfied in our problems because we 
have to deal with entire functions. The symbol * is used for the so- 
called convolution, as explained by equation (4). 


4. Calculation of Y,(t) by expansion in series. The type of ex- 
pression which is obtained by expanding Y,,(t) in power series of the 
intensities of recovery g; may be seen in the following manner. The 
determinant D(0, ) is a polynomial in the sums (s+k;) and may 
be written in the following form: 
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D(0 ’ n) a Teal t = 3 a, Fin (ki ’ gi) Tm) faa] ’ (10) 
‘where for brevity 
septs IE (8) xn Kes), (11) 
al 
F,,,(k; , gi) is a polynomial of certain k,’s and gis and IJ (m) stands 
for a product of certain m terms s + k; with m Sn. If theterm [---] 
in equation (10) is written as a polynomial in the g;’s and the ordi- 
nary rules of expansion of a reciprocal of a polynomial into a power 
Series are applied, the following expression is obtained from equation 
(2): 


TInt Yn (8) /Pn =1—3 | II (p;) /I1(q;) pee, (12) 


jot 


‘where JT (p;) and JJ(q;) have a similar meaning as I7(m), p; < @;,; 
cand f;(k;) is a polynomial in k,’s, whereas G;(gi) is a product of 
some g;’s or of their powers, the sum 5; being extended for all such 
products for which f;(k;) +0. Since (p;) is a polynomial in s of 
degree p;, whose coefficients are polynomials in the k;’s, equation 
(12) may be written also in the form: 


Tues Yn (8) /Pn=1—S Gj (9s) Se fin (ks) (8/1 (G1, (18) 


-where the sum 5, is taken for yr —0,1,--- p; and f;,,(k:) is a poly- 
‘nomial in the k;’s. 

Now Y,(¢) can be obtained from equations (1), (2), (13) and 
(4) to (9). We put for brevity 


da dts: e; — exp(—i;t), (14) 
Cis eae Gataede "hg Mais 3 (15) 

:and call &(q;) the convolution of any q; exponentials e; , so that 
Z{Enu38}=1W/Mnn, 2 {E(g;) 58} =1/1 (4). (16) 


‘Since the lowest term in the expansion of €(q;) in power series of ¢ 
‘is of degree = q; — 1 (see Opatowski, 1942), we have: 


d:” €(q;) =0for ¢=0ifm=q;—2. 
‘Therefore, by equation (8), since r = pj = q; — 1: 
Q {d," E(q;) ; 8} =8"/11 (qj). 


‘Taking into account these relations, we obtain from equation (13) 
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Y,(t)/Px=1—3 Gj (gi) De fir (hs) Ena *ds” E (5) « 
j=l 
We proceed now to an explicit calculation of this expansion up 
to terms of second order in the intensities of recovery gi. It may be 
seen from the expression (3) of the determinant D(0, n) that a 
given g; is contained only in the (¢+2)-nd column which is 


Ue Sos el Urs Ji; S haet 01, ices 0 23,02 


Consequently, the derivative of D(0, n) with respect to that gj is 
obtained by changing the above column into 


Ose 25.05 LT, 1. 1 bee Con 


Since the second 1 is here an element of the main diagonal, it is clear 
that by drawing lines between the (¢+2)-nd and (i+3)-rd rows and 
between the (1+2)-nd and (i+8)-rd columns, the determinant in 
question is split up into four square arrays, the elements of the left 
bottom array being all zero, those of the right bottom array forming 
the determinant D(i+2, n) [cf. Part I, equation (13)] and those of 
the left top array forming a determinant which expanded according 


to the elements of the last column is 
D(0,t) —Kin D(O,i—1). 
Consequently, 

0 D(0,)/og; = [D(0 , 7) — kins D(0 , 1-1) ] D(t4+2,n). (17) 
Actually, this relation holds only for 1 = i S n—2. However, it is 
seen by a direct calculation that equation (17) holds also for i = 0 
and i= n—1, if we put by definition 

D(0,—1) = D(nt1,n)=1-. 
Putting in D(p,q) zeros for all the g;’s, all the elements of this de- 
terminant above the main diagonal become zero, so that 


[D(p, Qlo=T (st+Kin) , (18) 


i=p 


where the symbol [ --- ], means that the calculation is carried out for 
all the g;’s put equal to zero. From equations (17), (18), and (11) 
we have now 


[2 D(O, 2) /2 giJo=s S(i+1, 142) Haar, (19) 
where for brevity 
S(i+1, i+2) =1/[(st+kis.) (8tkis)] . (20) 
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The latter symbol will be used in a general manner, viz. 


i=q 
S(p,q) =1/H1 (s+ k&), (21) 
i=p 
so that 17, = 1/S(1,7). Since a given g; appears at most in one 


column of the determinant D(p, q) [see Part I, equation (13)] its 
expansion will contain each g; at most to the first power, so that the 
terms of higher order consist only of mixed products of the g;’s. These 
terms may be calculated in the following manner: the terms of the 
second order are 


nl 
> je" D (0, ) /eo: 0g; | Ji 9;, (22) 
4,7=0;j>i tt) 

and may be calculated by differentiating equation (17) with respect 
to g;. It is clear from Part I, equation (13), that D(p,q) contains 
only those g;’s for which p—1 = 7 = q—1. Consequently, on the 
right-hand side of equation (17) only D(i+2, n) contains g;’s with 
j 21i+1. Therefore, we have for the general term of the sum (22): 


o D(0, 2) /0gi 09g; 


(23) 
= [D(0,7) —kin D(0, i—1)] 0 D(i+ 2, n) /og;. 


But for cD(i+2 , n) /ég; we may write an equation similar to express- 
sion (17): 
@D(i+2 , n) /og; = [(D (442, 9) — kj D(14-2 , J—1)] D(G+2,n), (24) 
with the condition that 

DG@42,7+1) =1, DG@4+2,t)=—0, (25) 
so that for 7 =i+1 the term [---] in equation (24) equals 1 and for 


j =i42 it equals s + gi.,. Putting all the g;’s equal to zero we obtain 
from equations (23), (24), (25), (18), (11), (20), (21): 


?D(0,n) |] _{sS(t+1,i1+3) Wau for j=i1+1 
39:99; > (8? S(i+1,1+2) S(G+1, 9742) Tan for: Sa 


Consequently, the expansion of D(0,7) up to terms of second order 
in the g;’s is 
n-1L 
D(0, 2) /Tna =1 + Pi sS(i+1,1+2)9i + 


4, j=0; 7Zir2 


(26) 
s?S(it+1, i+2) S(G+1, 9+2) 9: 9; + Ds S(é+1, 148) 9: Gia +. 


i=0 
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Higher order terms may be calculated in a similar manner. Expan- 
sion (26), and those which will now be derived from it, hold for any 
n=2. Ifn=1, there is at most one gi, viz., go, and the determi- 
nant (26) is a linear function of gq. 
Applying the known rule of division of power series, viz., 
1/(lt+ Saja, +ai;%4j, 4; +--) = 
Ea) 
1+ > — 4; XL; == a; dpe + (2a; ah; — A;;) x; Xj == air 
iE) 


we obtain from equations (2) and (26): 


Tia Yn (8) /Pn = 1 + >> — $S (ttl i222) o55- 


i1,j=0,j=14 
s? S(i+1, i+2) S(j+1, 7+2) 9: 9;— (27) 
cy ys 8 G21 442) 8012 


The expression of Y,(t) may now be calculated from equations 
(27), (14) to (16), (20), (4) to (9), and the following formula: 


Cnn Oe mr if oho = 


One obtains 
m1 
¥4(8) (P= Cas Fe Cues : ee — d; (@in = Ci) 9i 


i,j=0;72>i 
+ dy? (Cina * Cire * Car * Cpe) 9 D5 (28) 
4=n-2 
= > Kia dG [ein * (tei) * Cis] 9:9in + ae 


4=0 

The first term &,.. of expansion (28) represents the effect of direct 
transitions alone, the remaining terms represent the effect of recov- 
ery. Each coefficient of this expansion is a sum of exponentials in t 
multiplied by a polynomial in t of degree = 0. The calculation of 
Y,(t) according to expression (28) does not present any theoretical 
difficulty ; it becomes, however, quite lengthly if the number of states 
is large. This inconvenience may be eliminated in some simple types 
of processes, as will be shown in the next part of the paper. 
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CELL GROWTH AND SHAPES: II 


RICHARD RUNGE 
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_ A theoretical study of the growing nerve cell filopodium is made 
using the assumptions of volume constancy, cylindrical shape, and sub- 
strate track of an earlier paper, but assuming additionally that a re- 
tarding force per unit area proportional to the rate of elongation is also 
acting. Equations of elongation for two different cases are derived. 


In an earlier paper (Runge, 1945, hereinafter referred to as loc. 
cit.) a theory of the growth of nerve cell processes was presented. 
The theory covered two types of cell substrate relations correspond- 
ing to both isotropic and anistropic interfacial tension forces on the 
cell substrate interface. 

In both of these cases the theory was developed both with and 
without frictional forces being taken into account. 

The assumption made concerning the frictional force was that 
it was directed opposite to dz, where dz is an increment of length of 
the cell-process, and that its magnitude was given as f.S.s, where fo 
is a constant and S,, is the area of the cell substrate interface. Fric- 
tional forces acting on the cell medium interface were ignored in this 
discussion. The force f/,S,; was assumed to act only when dz/dt #0, 
and the essential feature of this discussion as far as frictional forces 
were concerned was that f.S-; was independent of dz/dt. However, 
since the cell-process is a plastic fluid, a truer picture of the adhesion. 
between cell and substrate is obtained by stating that the adhesion 
force per square cm of cs (cell substrate) interface is given by a term 
1, dz/dt, where 1, is a constant of proportionality with dimensions 
MLT-. Then the total friction force on the cs interface is given by 
the expression 


d 
loScs = (1) 


A similar argument involving the em (cell medium) interface would 


give us a term 
dz 
MoS cm dt’ (2) 
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for the total friction force on the cm interface. Making use of the 
equation of elongation of a viscous thread referred to as equation (15) 
in loc. cit. and the expressions (1) and (2), we obtain for our equa- 
tion of elongation 
AEF fie 8. + Sen) SI (3) 
zdt. 3nAo| dt | 
In equation (3), 7 is the viscosity of cell-process, A, is the cross- 
sectional area of the cell-process, F is the resultant interfacial ten- 
sion force parallel to the z-axis, and z is the length of the cell-process. 
In the case of anistropic interfacial tension of the cs interface, 
this interface is approximately a flat rectangular strip, and the force 
F is given by the expression —dH’/dz in loc. cit. From equations (18) 
and (20) of loc. cit. we find 


F=—6 y(a— £)Q7, (4) 
while A, , the cross-sectional area of the cell-process, is given as 
A,=?r (a— B). (5) 


In equations (4) and (5), Q, is a constant and r is the radius of the 
cell-process and is related to z by the constant volume equation 


r(xn—fp)2z—V, (6) 


where V is the constant volume of the cell-process and £ is the con- 
tact angle of cell-process and substrate fiber. 

In this case equation (1) of loc. cit. gives for S., and the longi- 
tudinal portion of S.,, the values 


Scs = 2rz sin B 
ca heyy (7) 


Introducing equations (4), (5), (6), and (7) into equation (3), we 
obtain upon solving for dz/dt 


dz... Az’? 


dt B + C25/2’ (8) 
where 
A=—6 n(a— B)Q. >0 
B=8nvVV(a—B) >0 (9) 
C=2[l—m(xa— 8)] >0 


Inspection of equation (8) and inequalities (9) shows that dz/dt > 0 
for z > 0; hence elongation once begun will continue indefinitely, un- 
checked by adhesion forces. Equation (8) shows that as z > o, 
dz/dt > 0. 


= 


RICHARD RUNGE ky) 


Let us now consider the case of isotropic interfacial tension 
forces. The values of V, A, , and S,, are given by equations (48), (50), 
and (38) of loe cit.: 


V=a(r?*—a?)z, (10) 
A, =a(1?— a?), (11) 
S62 nur: (12) 


If we assume that m, is negligible, then introduction of equations 
(10), (11), and (12) into equation (3) gives 


dz ve F 
dt 3nV 


2? 


: (13) 
ata 2 wt al oz 


If we also assume that yom is negligible, then [Runge, loc. cit., equa- 
tion (49)] F will be constant and equation (13) may be written 


dz ere 


dt G+ He’ Oy 
where 
G=37V>0 
Ye Baar a ee |) ; (15) 


F=220(yms — yes) 
Inspection of equation (14) shows that dz/dt = 0 for z = 0 and 


z= o. 

Inspection of equations (8) and (9) shows that dz/dt > 0 just 
in case A > 0, since B and C must exceed zero. This is equivalent 
to the condition Q, < 0, which is the necessary and sufficient condi- 
tion for dz/dt > 0 in the anistropic case without friction, loc. cit. 

From equations (14) and (15) we have that H and G must ex- 
ceed zero, hence for dz/dt > 0 , we must have F > 0, 1.€., ¥ms— Yes > 0. 
This condition is not the same as the necessary and sufficient condi- 
tion for dz/dt > 0, in the isotropic case without friction, as discussed 
in loc. cit. It should be recalled, however, that in the discussion re- 
ferred to, the value of y:m was not treated as a negligible quantity. 
In neither case do we find a constant value for dz/dt. The functions 
of equations (8) and (14) will vary considerably with z for values of 
the coefficients which can be estimated from expected values of V, 7, 
the y’s, a r, etc. 

A necessary condition of F for a constant dz/dt can be obtained 
as follows. The equation of elongation for a viscous thread is 


- 
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13a F 
By ake oe (16) 
zdt 3nA 
Since 
Az=TV, (17) 
we have after combining equations (16) and (17) 
387V d 
pee ee (18) 
a dt 


in other words, the force must vary inversely as the square of the 
length of the thread. 
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The author’s earlier treatment of diffusion through a membrane is 
extended to include the case in which there is a mass motion of water 
through the membrane. Water flows through the membrane in the di- 
rection from lower to higher concentrations of the solute. This water 
carries a part of the solute by convection. Thus in this general case 
there is a transport of solute through the membrane both in the direc- 
tion from higher to lower concentration, and in the opposite direction. 
If the latter effect prevails, the net result is a flow of solute from lower 
to higher concentrations. Mathematically this corresponds to negative 
values of the permeability. The effect of hydrostatic pressure is con- 
sidered also. 


In a previous study (Bloch, 1944) the author developed some 
general expressions for the permeability of a membrane, regarded as 
a potential well or barrier. In the present paper the effect of flow 
of water through the membrane will be discussed. Water flows from 
the side of the membrane on which the concentration of the solute is 
smaller, to that on which it is greater. This flow of water is thus op- 
posed to the flow of the solute. As a result, there is a tendency for 
the molecules of the solute to be dragged by that water flow in a di- 
rection opposite to that of the normal diffusion flow. Under certain 
conditions this convective effect of the water flow may exceed the 
effect of diffusion transport through the membrane, and the solute 
then will flow from lower to higher concentrations. Formally this 
situation is described by a negative value of the permeability of the 
membrane to the solute. 

Although the discussions in this paper are still on a rather ab- 
stract level, even in this preliminary form they may give a clue to 
the well known phenomena of accumulation of electrolytes in cells, 
with transport towards higher concentrations. 

The notation used in the author’s earlier paper on membrane 
permeability (Bloch, 1944) will, with a few slight changes, be kept 
here. In addition let 


I= flow of water, in gm/cm? sec, in the + x direction, 
h= permeability of the membrane to flow of the solute, 


21 


22 MEMBRANE PERMEABILITY 


J = flow of the solute, in gm/cm? sec, in the + z direction, 


W (x) = potential energy of a solute molecule as a result of the 
flow of water, 


P,, P: = hydrostatic pressures on the two sides of the membrane. 


The permeability for water is usually defined as the flow of water 
per unit area per unit difference of osmotic pressures on the sides of 
the membrane (Rashevsky, 1938, p. 101; Oppenheimer and Pincussen, 
1933). Since the osmotic pressure is proportional to the concentra- 
tion, the permeability H for water is here defined as the flow per unit 
area per unit difference of the concentrations of the solute on the two 
sides of the membrane. 

The effect of water-flow on the diffusion of a solute through a 
membrane is equivalent to the superposition upon the membrane po- 
tential function V(x) of a function W(x), the potential energy per 
gram of the solute as a result of water-flow. If it is assumed that a 
flow I of water in the absence of a solute concentration gradient pro- 
duces a flow of solute 


Jeb? (1) 
then W’(a) may be obtained for this case: 
cH! toccel 5 
irr ) 


If W’, as obtained from equation (2), is substituted in the gen- 
eral equation for c(x) (Bloch, 1944), the result is 


Bt Bia Sees (3) 


The solution of equation (3) is 


o 
ef (V'/kT-I/D) de 
Bi 


As before, 
Vide 3 2 
ar eer os ( i ) 4; _ (5) 


3k 


* This is inaccurate because the b: ; : . 
lute by water. membrane will resist the entrainment of so- 
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whence 


2 3/2 
co=( Poy ) | exp [I 5 (dx/D)1| 


3h 
; (6) 
Po -8/2 exp[— 
“| a if (1. (2/3k) VI} expl—I S(dx/D)] 
=B, D 
Now 
Co= To? aexp [If , (dx/D)). (7) 
If f _,and te denote integrals evaluated at x = —B, and atx = B., re 
spectively, then 
c= ( ey "| nea cee 
3k J 
a : 
‘LTS exp [,, @z/D)I He 
(fs (2/3k) V]-*? exp [—I S (da/D)] | 
—~ $$ dx]. 
-B; D 
Also 
— 7.3/2 Co 
Say 7. expI { , (dx/D) 
= if [.— (2/8k) V]-? exp [—I J (dx/D)] te aio: 
D 
-By; 
exp [I f, (dx/D)] , 
or 
¢, = ¢, exp [I [* (dx/D)] 
(10) 


da. 


"LP. — (2/3k) VI? exp [I [® (dx/D)] 
anes JT 3/2 i i ese Pi a a a 


By 
It is sufficient here to treat the special case 
V=0 for xz < —b and forz > b; 
V =), for —b= 220d; (11) 
b=B,=B.. 
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Let 
D(z) =D, for—b=xSb; 
y =exp LI — [?(dx/D)]. 
Now 
y — e251/Do : 
and 


exp [I [?(dx/D)] =exp [1/D,(b—=a)] for—bS fb: 


Hence 


6 
1 — (2V,/38kT) 1°? 
ay Co — Al ee el/Do(b-2) dx 
0 


6 


J QV, \3/2 
— iS +- 1 a ik — yy). 
Ree TG ( 3kT. ) Gx 


The quantity h is defined as follows: 


Therefore, 
- ¥Cy— Cy 
hy eee ee 
pi Co fr CoG 


3/2 
cial 1 2V, Y Co — Cy 
yl SkT, fie! Oe 


(12) 


(13) 


(14) 


(15) 


(16) 


(17) 


If in the absence of a difference of concentrations (c¢, = c,), there is 
a difference of hydrostatic pressures on the two sides of the mem- 
brane, then the flow is proportional to that difference; hence, in gen- 


eral, 
I=H(c,—c) + K(P, —P,) 


=F (v—u) + (y—2) | , 


(18) 
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where 
¥ 2bH 2bK 
= Co; y= : 
ri ean 
_ 2bH 2bK i 
ear ae Cy , z = 1 
Dy Dy 


The constants H and K are not independent. Approximately 
H = RTK/M, where R is the gas constant and M the molecular 
weight. Thus 


j=: 1 (free) 


il ese @25/DoLH (¢1-Co) +K (PoP) ] C—O 
20 
2V, 2/2 ( ) 
i | = ) ( Co @26/DoLH (¢1—-Co) +K (Po-P3) ] — Cy ) 
( 3kT, 
or 
K(P,—P, Pll RNY 
gape RY) 
Co— Cy 3kT, 
Co €20/Do (KPo-Heo) — @, @20/Do(KPs-Her) (21) 
€2/Do(KP;-He:) —_ g20/Do (K Pe-H¢o) ? 
or, by equations (19), 
=> (1 Fea) 2Vo i 
2b u—v ( ohlig 
(22) 


ue — ver” 


e7-t anil ey-4¥ i 


In this paper discussion is confined to the special case in which 
y =z, or there is no difference between the hydrostatic pressures on 
the two sides of the membrane, discussion of the more general case 
in which y + z being left to another paper. If y=z, 


3/2 


Ds; ZV. = v 
‘3 ( 5 ue SEL (28) 


+ 2b 3kT, ev — ee 


In view of the fact that permeability can be negative only when 
water flow is sufficient to make the solute flow from regions of lower 
to regions of higher concentration, it can be seen from equation (18) 
that h is most likely to be negative when H is large, while equation 
(1) shows that, ceteris paribus, negative values of h should accom- 
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pany large values of c, and c,. Thus, the definitions of u and v being 
given by equation (19), negative permeabilities might be expected to 
result from large values of these quantities, as is indicated by Fig- 
ure 1. 

Here the line h = 0 is the curve we“ = ve” in the uv plane; in 
the region below and to the left of this line, 


u=const. >] 


u=const<] 


FIGURE 1 


ue“ — ve 
eat 
ev = e-# 
or 
h>0, (24) 
while above and to the right of this line 
h<0. (25) 


In biological systems a relation often exists between c and ¢,, 
and hence between wz and v. Such relations may be given, for in- 
stance, by the diffusion equation. In the case of a single cell in an in- 
finite medium with constant concentration ¢, outside the cell, then 


w= const. ; (26) 


In the case of an isolated non-metabolizing system of two cells, or 
other regions, of constant volume with a membrane between them, 
the equation is 


eutnv=u, (27) 


where « and 7 are proportional to the volumes of the two regions, and 
« is proportional to the total amount of solute present in the system. 


r 
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The state of a system is represented by a point on the graph, in 
the uv plane, of its equation of state. As time passes, this point moves 
along the locus of the equation of state toward or away from the line 
u = v according as h is positive or negative. 

Figure 1 illustrates some possible behaviors of the single cell in 
an infinite medium, whose equation of state is equation (26). 

If u > 1, the equation of state is represented by the upper hori- 
zontal line in the figure. If now the initial state of the system is rep- 
resented by a point to the right of point 1, this point moves farther 
and farther to the right as time passes, h being negative. This means 
that water flowing into the cell carries solute with it. more rapidly 
than the solute can diffuse in the other direction. If, on the other 
hand, the initial state of the system corresponds to a point between 
point 1 and point 2, the representative point moves to the left until 
it reaches point 2; if the representative point starts to the left of 
point 2, it moves to the right to point 2. Thus point 2 represents a 
stable configuration of the system: the representative point of the 
system returns to it after a small displacement from it in either di- 
rection. This means that if, initially, w > 1 and v < u (i.e., the con- 
centration of solute in the cell is less than that outside), v has a stable 
value less than the value of wu, at which value it remains as long as 
water is able to flow from the cell fast enough to maintain the con- 
centration difference across the cell membrane. 


If the cell is in a medium for which u < 1, the state of the sys- 
tem is represented by a point on the lower horizontal line in Figure 


FIGURE 2 


- 1. In this case the representative point moves to the right with- 
out limit if it has started to the right of point 3; if it has started to 
left of point 3, it reaches the stable point 4 and stays there. In this 


28 MEMBRANE PERMEABILITY 


latter case, the stable state is one in which there is no flow of water, 
the concentrations of the solute being equal inside and outside the cell. 

The case of two coupled cells, whose equation of state is equation 
(27), is illustrated in Figure 2. 

The upper of the two downward sloping straight lines represents 
the equation of state for the case in which this line cuts the curve 
h = 0 (i.e., the case in which u > e + 7). Reasoning similar to that 
applied in the preceding cases shows that if the representative point 
starts from the right of point 6 on the line ew + nv = mw, it goes to 
the stable point 7, while if it starts from the left of point 6, it goes 
to the stable point 5. Flow of water from one region to the other is 
needed to maintain the system in a steady state corresponding to 
either point 5 or point 7. 

In the case illustrated by the lower of the two downward sloping 
straight lines in Figure 2 (the case in which u = e + yn), there is 
only one stable state, that represented by point 8; maintenance of 
this state does not require water flow. 

It is interesting that, at least in the two cases considered, a stable 
state can exist in which the concentrations of solute on opposite sides 
of a permeable membrane are different. However, in both these cases 
the concentration differential of the solute is maintained only as long 
as water is able to flow fast enough. Thus the “steady” states in 
question can be really steady for long times only if there is rapid 
water metabolism, and even in this case the other metabolites are 
probably flowing in great enough quantities to influence the concen- 
tration of any other solute about as much as does the flow of water. 
Thus it appears that the type of treatment given here is somewhat un- 
realistic for any system of two regions, one of which is closed. The 
treatment of the case involving two non-closed regions (e.g., the case 
of diffusion from capillaries, as in the kidney) is complicated by the 
fact that v cannot be expressed as a unique function of uw. 
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A theory of such neural circuits is developed which provide for 
formal logical thinking. As a by-product of this study, a neural mech- 
anism is indicated which provides for the conception of ordinal numbers. 
A quantitative theory of the probability of erroneous reasoning and of 
the speed of reasoning in its relations to other psychological phenomena 
is suggested. 


in a previous paper (Rashevsky, 1945a) on this subject we sug- 
gested that neuron circuits, which will explain formal logical think- 
ing, may be constructed by the use of the symbolic logic method of 
W. S. McCulloch and W. Pitts (1943). To use this method we need, 
however, some assumptions about what constitutes the neurophysio- 
logical counterpart of such statements as “all A’s are B’s” or “‘some 
A’s are B’s’, etc. 


I 

One of the simplest assumptions is to consider a statement like 
“all A’s are B’s” as a stimulus pattern consisting of the sequence of 
the stimulus A , a stimulus corresponding to the notion “all... . are”, 
and of the stimulus B. In ordinary language the stimulus “A” is 
actually preceded by “All” and followed by “are”. This complicates 
the situation somewhat, but does not change it in principle. If we use 
symbolical notations, we may write “AaB”, in which case we do have 
a sequence of of three stimulli. 

Therefore, without any loss of generality, we may consider that 
the statements “All A’s are B’s”’, “Some A’s are B’s”, “No A’s are 
B’s”, and “Some A’s are not B’s” are temporal sequences of stimuli 
“AaB”, “AiB”, “AeB”, and “AoB”. Then we may say that a logical 
inference of the mode “barbara” is made if the presentation of the 
sequence “AaBCaA” is automatically followed by “CaB”. Similarly, 
an inference of the mode “darii’” is made when the sequence 
‘““AaBCiA” is followed by “CiB”. 

Let the perception of “A” correspond to the excitation of the 
neuron N,, the notation “a” (“all-are”), to the excitation of neuron 
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N,, ete. Then, using the same notations as in a previous paper (Ra- 
shevsky, 1945b), a network which is described by 


Nc (t) = Na(t—6) - Ni (t—5) - Nz (t—4) 
-No(t—8) - Ni (t—2) -Na(t—1); 
N,(t+1) = N,(t—6) - N,(t—5) - Ng (t—4) (1) 
ry a4qyi » No (t—3) -N;(t—2) -Na(t—1) -Ne (4) ; 
Ng(t+2) = N,(t—6) - Na (t—5) - Ns (t—4) 
. No (t—8) «Ns (t—2) -Na(t=1) - No(t) - 


Ni (é+1), 


may be said to be able to “reason” in the mode of “darii”. There is 
no difficulty in: constructing networks for different modes of the Aris- 
totelian logic, by'using the method of W..S. McCulloch and W. Pitts. 

Such a procedure, however, has several weak points, of which we 
first discuss one. The circuit, represented by equations (1), is timed 
in such a way that the stimuli A, a, B, C, i, A, etc., follow each other 
at intervals of one synaptic delay, that is, about 0.5 ms. By the inter- 
calation of a proper number of internuncials, it is easy, however, to 
make this interval as long as desired. It is also possible to make the 
intervals between different stimuli of the sequence not equal. But in 
all cases those intervals are fixed in their magnitude. This is neuro- 
physiologically and psychologically, to say the least, very unplausible. 
What is needed, for instance, in the case of the mode “darii” is that 
the sequence “CiB” shall follow the sequence “AaBCiA”, regardless 
of the intervals between the individual items of the sequence. 

To construct:such a circuit we must first study a simpler cir- 
cuit, namely, one described by 


N; (t) = [(Ex)N,(t—2)] - [(Ey) N.(t-4)] 


-fe>yt+m]-lysn], Co 


where m and n are positive integers. 


As has been shown previously (Rashevsky, 1945b), such a cir- 
cuit requires the introduction of closed circles of neurons. The cir- 
cuit which realizes expression (2) for m = 0, n = 8 is represented 
in Figure 1. The thresholds of all the neurons, measured in terms of 
the minimum number. of terminal bulbs which must be excited with- 
in the period of latent addition, are assumed to be equal to 2. 

In any actual situation, the intervals between any stimuli in- 
volved in logical thinking are of the order of at least several hundred 
o’s and usually even much larger. This means a very large m. To 
simplify notations,'we shall in the following write simply x >> y. 
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N3 


Ny, No 
FIGURE 1 
Because of the inhibitory fibers going from C, to N,’, C, cannot become ex- 
cited if N, fires before N,. If N, fires before N,, then both C, and C, become 


permanently excited, and N, receives at regular intervals ¢ two impulses simul- 
taneously. 


We introduce the following abbreviation, denoting by x, y, z, and 
u positive integers, 3 
N;: Ni: Np: ---N,= [(Ex)Ni(t—2)]- [ (Ey) Ni. (ty) ] 
- [(£z)N,(t—z)]-...[(Bu)N,(t—-»)] (3) 
Teo Sg eee OS aS nN . 


From such circuits as shown in Figure 1, we may now construct 
a circuit which realizes the following expressions, in which » and q 
again denote positive integers, 


Neolt) = Nu: Na: Nz: No: Ni:-Nai 
Ni(t+p) = (Na: Na: Ne: Neo: Ni: Na) -No(t); (4) 
N3(t+p+q) = (Na ‘ N, ; Ne e No F, N; Z Na) -Ne(t) -N;,(t+p). 


The circuit, which realizes expressions (4) is shown in Figure 2, 
for p = q = 1, the time unit being the synaptic delay o. 


The circuit has the property of “reasoning” in the mode of 
“darii’’, but only the time intervals of the “conclusion” “CiB” are 
fixed; those of the major and minor premises being arbitrary within 
the limitation imposed on all such circuits, namely, that they are all 
integer multiples of o. 

From the standpoint of formal logic, we should have a circuit 
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FIGURE 2 


The threshold of the neurons are indicated by numbers. The reverberating 
circuit @ becomes excited only when N, fires for a second time. The first firing 


of N, excites circuit a. The excitatory fibers from the two “halves” of circuit 
a provide the lower neuron of 8 with one impulse every ¢. If then N, is excited 
the second time, two simultaneous impulses are received by the lower neuron of £. 


which not only gives AaBCiA — CiB, but also BaCAiB — AiC, as 
well as any other of the 6 permutations of ABC. To this end, we 
should connect in Figure 2 neuron Ns with N4, N., Ni, Nz and Nez in 
the same manner as N, is connected with Ns, N., Ni, Ns and Ne, 
etc. For the three stimuli alone we shall obtain a circuit of some 
sixty-nine neurons. (Some neurons may perhaps be used in common 
for all three circuits.) Approximately the same number of neurons 
will be required for the other eighteen modes. If we have M stimuli, 
which can be formally connected by a, e, 7, 0, then any three of 
those stimuli must be connected to N,, Ne, Ni, and Ny so as to give 
any of the nineteen Aristotelian modes. Altogether this will require 
approximately 


| M! 
N=69 X19 TR (5) 
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neurons. For all practical purposes, M is infinite. Taking M = 10%, 
which is too low an estimate, gives N © 10" neurons, which is biologi- 
cally absurd, since the total number of neurons in the human brain 
is of the order of 10”. 


II 

The solution of the difficulty may be sought in the following. 
When in formal logic we think (or say) “All A’s are B’s”, the “A” 
stands actually for “the thing about which it is said “All... are”. 
Similarly, “B” is merely the thing that follows “All A’s are”. Hence 
in the circuit shown in Figure 2, for the mode “darii”, N4 must be 
excited every time when any other stimulus precedes N,; while Nz 
must be excited every time when any other stimulus follows N, . Sim- 
ilar situations should hold for other circuits which correspond to 
other modes of logic. Hence we must construct a circuit such that if 
any neuron S; fires before N,, making a sequence S;N,, then S; must 
become connected to N,, so that henceforth every firing of S; will 
be followed by a firing of N,. The principle on which such a circuit 
is based is to have between each S; and N, a circle C(S;, Na), Fig- 
ure 3), the excitation of which is necessary for a permanent connec- 


FIGURE 3 
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tion between S; and N,. If in expression (2) we substitute C(SiNa) 
for N.; S; for N, and N, for N2, we obtain the expression describing 
the circuit. Such a circuit is shown on Figure 3 with only two S;’s. 
Any number of S;’s, however, can be used. The number of inter- 
nuncials involved per S; is only 6, so that if the total number of S;’s 
is M , 6 M neurons are needed. 

If in the circuit shown in Figure 3 the sequence S,S,N, is pre- 
sented, then both S, and S, become connected to N,. In this case, 
S, + S. is actually the stimulus preceding N,. 

Since similar connections must be made between any S; and N; 
and N< respectively, the total number of necessary neurons increases 
to 18 M. Next, connection between S;’s and Nx, Ng, and N- must be 
made for sequences S;N;; SiN-; SiNo which would raise N to 72 M. 

All those circuits, however, will still not fulfill all the require- 
ments. The main difficulty arises when we have, for instance, a se- 
quence S,aS,S,aS,, giving as a conclusion S,7S, (mode bamalip). 
Here S, first follows ‘a’ and then precedes it. Hence, after becoming 
connected to Nz, it will then become connected to N, and confusion 
will result. Moreover, while in the above sequence S, will be excited 
before N, , due to time lags in the circuit of Figure 3 N. may actually 
become excited after N,, whereas for the working of the mechanism 
discussed in section I and exemplified in Figure 2 the excitation of 
N. must precede that of N,. 


Ill 


A way out of the difficulty may be found by taking a slightly 
different viewpoint. We may require that in any sequence, say 
S,aS/SniS; , constituting the premises of a syllogism, the first of the 
stimuli S connects with N,, the second, different from the first with 
N; and the third with N,. Thus we will have the connection S; — Na; 
S; — Ne S,— Ne . 

In a sequence S,aS,S,aS, , S, will become connected with N,, S,, 
with Nz and S, with N,. Since when a sequence, say S,aS,S,aS, oc- 
curs, the sequence S,iS, must follow automatically, the connection be- 
tween the S’s and the corresponding N,, Ns, or Nc must be two-way 
connections, so that excitation of N, results in an excitation of S,, 
etc. However, this two-way connection must not be a closed self- 
reverberating circuit, which will keep both S, and N,, or other corre- 
sponding pairs, excited indefinitely. 

First we shall preoccupy ourselves with the problem of the con- 
nections from the S’s to N,, Ns, and N;. Consider the structure rep- 
resented in Figure 4. Let application of stimulus S; result in the ex- 
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Na Ne 
FIGURE 4 


In order not to make the drawing too complicated, only a few connections are 


shown. Thresholds are indicated by numbers. The neurons of the circuit C. 
KC 


have a threshold 3, because they are excited only if besides S, two other circuits 


Oe and Cee have already been excited. Those two circuits send each excita- 


tory fiber toC. 
S.C 


citation of neuron Ng, , application of S; in the excitation of Nz, , and 


so forth. A simple firing of any S; results in the permanent excita- 
tion of the circuits Cs,A. Whenever a circuit of that kind is excited, 


a connection between S; and N, is established, and if we have S;(¢), 
then, with the structure shown on Figure 4, we shall have N,(¢+4). 


If we denote by the symbol S;,(t) the statement that there exists 
at the time ¢ a connection between S; and N, such that an excitation 
of S, results in an excitation of N,; if we denote by Cs,4(t) the state- 


ment that at the time ¢ the circuit Cs, is excited, and by S;(t) the 
statement that S; is excited at the moment f , then we have 


Sxa(t) = Coa (t) ; Sia (t) = Cs,5(t) ,Sxo(t) = Cs, o(t). (6) 


The requirements for our mechanism, mentioned in the first para- 
graph of this section, may now be written: be 


Sua (t) = (Ex) S,(t—2) - (EASi(t)- GFR; 
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Sin (t) = (Ex) S,(t— x) - (£1) Sia (1) ~ 
- (E7)Sja(t)» GAD -G#Y; 
Smo(t) = (Ex)Sn(t — x) - (Et) Sia (t) - (EJ) Sia (0) 
- (ET) Sic(t) - G@#m) -(G#m)- (r#M). 
Introducing expressions (6) into (7), (8), and (9), we find 
Cs,4(t) = (Ex) Si (6 — 2) - (Ej) Cs a(t): (GFE); (10) 


Ce,n(t) = (Ex) Si (t— a) - (Et) Cs, 4 (0) 


(9) 


a: (11) 
- (Ej) Cs a(t) G¥D-G#D; 
Cs. ¢(t) = (Ex)Sn(t — 2) - (Bi) Cs, a(t) - (EI) Cs,2(t) 


fae. (12) 
-(Er)Cs c(t): (Am)-G#m); (r#Mm). 


In realizing expressions (10), (11), and (12) by a network, we 
see that the second term in the conjunction of the right side of ex- 
pression (10) requires that each circuit Cs 4 send inhibitory fibers 
to all other circuits Cs.4, where p # j. The second term of the con- 


junction on the right side of expression (11) indicates that every cir- 
cuit Css must be thrown into excitation only if it is excited simul- 


taneously by S; and by the already excited circuit Cs,4. According 
to expression (10) there can be only one such circuit at a time. Hence 
every circuit Cs, must send excitatory fibers to all circuits Cs B with 
j 2k. The third term of the right side of expression (11) requires 
that each circuit Cs, sp would send inhibitory fibers to all other circuits 
Css, With 1 # j. A similar analysis of expression (12) shows that 
each circuit Cs, and Cs» sends excitatory fibers to each circuit Cs_c, 


while each Cs sends inhibitory fibers to all others Cs_c, Where 
MF, 


With this arrangement, which for sake of clarity is only partly 
shown in Figure 4, any of the neurons S; which is excited first, will 
become connected to Ny; any S; which is excited second, will become 
ean sur to Nz; and any S; excited third will become connected to 

de 

It may be worth mentioning that such a mechanism provides us 
in principle with the theory of the concept of ordinal numbers. In- 
stead of three neurons N,, Ns, Nc, we may have a large number 
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N,, Nz, N;---, and every first stimulated S; will connect to N,, the 
second to N,, etc. Thus, regardless of their nature the stimuli S be- 
come labelled: the first, the second, etc. Together with the mechanism 
for “counting” the number of repetitions of the same stimulus dis- 
cussed before (Rashevsky, 1945b), we may have here a basis for a 
general theory of the conception of numbers. 

There remains now to connect N, (or Nz, or Nc) with the cor- 
responding S; , in such a way as to fulfill the requirements given at the 
beginning of this section. The way to do it is shown in Figure 4 for 
the connection between S, and N,. When S;, fires for the first time 
at the moment ¢, N, will fire at +4; but this firing will not make 
S; fire again, because at t+4 the internuncial N; receives also an in- 
hibitory impulse. But if at any time after the connection S;4 is es- 
tablished, N, fires, then S; will fire two o’s later. 

Hence when, for instance, a sequence S,aS,S,,iS; produces the 
sequence N.aN;N,iN,, which, by means of the mechanism shown in 
Figure 2, produces N,iNg, the sequence S,,iS; will result, provided 
the time lag between the firing of N- and of N; is greater than that 
between N, and S;. This can always be achieved by making in ex- 
pressions (4) p and gq sufficiently large. In fact, it is sufficient to have 
p > 2. This can be obtained by adding an appropriate amount of 
internuncials in the circuit of Figure 2. 

Finally, a mechanism must be added which disconnects the S;’s 
from N,, Nz, and N;,, as soon as the syllogism is completed. This 
can be done by having a neuron N; respond to, and only to, the whole 
sequence, say N,a@N;N-iN.N-iN; , which can be obtained by realizing 
expressions similar to expression (4). Then make N; send inhibitory 
fibers to all circuits Cs.4, Cs,8, Cs,c- 


With the mechanism discussed in this section and represented in 
Figure 4, there are 17 interneurons corresponding to each S;. Hence 
the total number of neurons necessary is 17 M. Even with M 10°, 
which is the order of magnitude of the sensory fibers reaching the 
sensory projection areas of the cortex, we find the total number to be 
about 2 X 10°, which is a very small portion of all neurons available. 
The total number of neurons involved in mechanisms like that shown 
in Figure 2 will including all additional internuncials, discussed 
above, not exceed the same figure, so that all told N © 2 X 10° neurons. 


IV 


All the above discussions are of interest as providing a mech-_ 
anism for logical thinking. The theory is, however, not directly amen- 
able .to quantitative predictions and experimental tests. To obtain. 
that, we must consider possible failures of the mechanism, and at- 
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tempt to evaluate the probabilities of correct and wrong conclusions 
or of the inability of making a conclusion at all (Rashevsky, 1945a). 
One of the ways of developing a theory of errors in the present case 
is to consider that the neurons N,, N;, N., and N, are excited by a 
previous excitation of four corresponding pathways, I, IJ, III, and 
IV, which are activated by stimuli S,, S;, S., and S,, which are 
cross-inhibiting each other, as discussed previously (Rashevsky, 
1938). We have here a generalization to four stimuli of H. D. Lan- 
dahl’s (1938) circuit. Now N, will fire only if S, is much stronger 
than the other stimuli, and so on. But due to fluctuations of excita- 
tion in a certain percentage of cases, N; may, for example, become 
excited, although S, is applied. General expressions for the probabil- 
ities of such occurrences have been given by H. D. Landahl (1938). 
They may be elaborated and applied to our problem. An error in logi- 
cal thinking is ascribed according to this picture of the fact, that al- 
though for instance, actually S,S,S; is presented, the central mech- 
anism will give S,N;S.. A confusion thus results. 

If we have a chain of syllogisms, as discussed before (Rashevsky, 
1945a), we must keep in mind that in the present theory each syl- 
logism of the chain is the result of functioning of the same mechanism 
which every time simply becomes connected to different stimuli S;. 
Hence we cannot talk of mutual inhibition or excitation of the dif- 
ferent units. Instead we may consider fatigue phenomena, which 
raise the thresholds of the tracts J, IJ, III, and IV, with repeated use; 
or we may consider facilitation phenomena, which decrease those 
thresholds with repetition. Since the probabilities of the correct or 
wrong conclusions are functions of those thresholds, we shall thus 
again obtain expressions for the probability of a correct or wrong 
conclusion of a whole set of syllogisms in terms of the total number 
of syllogisms required by the problem. 

The difficulty mentioned in the previous paper (Rashevsky, 
1945b) remains; namely, the necessity of having all intervals between 
the stimuli S,S,S,,, etc. be exactly integer multiples of « . This dif- 
ficulty may be overcome, as suggested in loc. cit., by constructing 
corresponding ‘“macro-circuits”. In the present instance, however, 
we may run into the difficulty of requiring more neurons than are 
actually available. 

A different solution of the difficulty leads to interesting conse- 
quences and suggestions. If the intervals between the stimulation 
of Nu, N., Ne, Ni, and N¢ are all integer multiples of o , then, for 
instance, all eight terminal bulbs synapsing with neuron N; in Figure 
2. will be receiving simultaneously impulses at regular intervals o . If, 
however, the above mentioned intervals between the excitation of the 
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neurons: N,, N., etc. are not integer multiples of « , then while each 
bulb will receive impulses at regular intervals o , they will not act syn- 
chronously, and neuron WN, will not fire at all, if the impulses do not 
fall within the period of latent addition. This, however, would be the 
case only if all synaptic delays were perfectly constant and all equal 
to «. Such a situation appears to be biologically rather unplausible. 
It is more likely that while the synaptic delay of a given neuron is on 
the average equal to oc, it actually fluctuates around that value accord- 
ing to some distribution function. Let 7 be the actual synaptic delay, 
then the probability of a given value of +, > + dz will be given by 


F(7)d-, (13) 


with 


J F@a=i; fo -POaae. (14) 


Instead of being concentrated all at the ends of the interval o, 
the eight impulses arriving at Nz now are distributed at random 
within the interval «. If 7 were constant, then the distribution of 
the individual impulses within the interval « would be the same for 
all consecutive intervals. But because of the fluctuations of 7, this 
distribution will vary from interval to interval «. We may ask for 
the probability that, due to fluctuations, all eight impulses fall with- 
in the period o; of latent addition. The greater the dispersion of 
F(z), the greater will be this probability, and therefore the shorter 
the probable time which it will take for this event to occur. But this 
probable time measures the probable speed of response to the prem- 
ises of the syllogism, or speed of reasoning. For zero dispersion of 
F'(,), that is, for a constant + (=c), the probability will be zero and 
the speed of reasoning zero. 

The actual calculation of the probability would have to proceed 
as follows: for a given average distribution of impulses in the inter- 
val « we can calculate the probability of each impulse to fall within a 
given fixed interval o; , and take the product of all those probabilities. 
Then we shall have to sum over all possible positions of o within co. 
Finally we shall have to sum over all possible average distributions of 
the impulses, which are determined by the exact intervals (N., N.); 
(N., Nz); (Nc, Ni), (Ni, Na). Here we would have to consider the 
finite duration 7* of an impulse, and consider the probability of a 
given position of any impulse in the interval « as equal to 7*/c. The 
probability of a given distribution is then (7*/c)”, where 7 is the 
number of impulses considered. (In the present instance, n = 8.) 
The tota] number of possible distributions would be equal to the num- 
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ber of possible ways of selecting m numbers out of (o/7*) > 7. This 
is 


(e/7*)2 
[(o/r*) —n] Int 


The details of such calculations will be discussed in a separate 
paper. We shall end, however, by making the following important 
remark. The same considerations apply to the mechanism for count- 
ing, discussed before (Rashevsky, 1945b) ; they will lead to an ex- 
pression for the maximum speed with which a stimulus may be re- 
peated and still be able to be counted. Assuming that the function 
F(7) is the same for the whole cortex, we shall find a relation be- 
tween speed of logical reasoning, and this limiting speed in counting. 
Both will vary from individual to individual. 


(15) 
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